MS1-630US 



102 



Prior Art 



104 



Source 1 



Source 
Filter 



H 



106 



Splitter 
Filter 




Transform 
Filter A 




110 



Transform 
Filter B 



100 




Application Program(s) 




COM 302 
Interfaces 



304A 



Source 
Filter 



306A 



Render Engine 



Transform 
Filter(s) 



Source 
Filter 



Transform 
Filter(s) 



^04N^ 306N 



308 



Dynamic Matrix 
Switch Filter 



306B 



Transform 
Filter(s) 



Transform 
Filter(s) 



216 



300 



222 



310 



Render 
Filter 



306C 



From Source (file, NN tape, AA/ device.antenna, etc.) 
From Source (file, AA/ tape, AA/ device, antenna, etc.) 



To Hardware 
Renderer 



y 



MS1-630US 




MS1-630US 



402< 



V.- 



410 



Media Time 



Input 0 



Matrix Switch 



Matrix Switch 
Programming Grid 



Output 0 
-406 

^408 



Input/Output 
Buffer(s) 



Input N 



Output N 



412 



Project Time 



308 



>404 



J 



MS1-630US 

• 




MS1-630US 



7^6^' 7 

D 



700 



Receive a request to generate media 
processing project utilizing resources 
of filter graph generator 



Identify number of media sources 
selected by user 



Identify required source, transform 
and rendering filter(s) to effect 
processing project 



702 



704 



706 



Based on user editing instructions, /|~ 
filter graph manager establishes a 
programming grid for matrix switch 
filter, identifying which inputs are to 
be coupled to which outputs at 
particular project times 



Based, at least in part, on the ' 
programming grid, filter graph 
generator establishes a matrix switch 
filter and assembles the filter graph 



Filters (re)negotiate buffer memory 
requirements between filters 



Execute media processing project on 
demand 



710 



712 



714 



MS1-630US 



712 



802 



Matrix switch notes the maximum 
buffer requirements for any object 
coupled to any of its inputs/outputs 



804 



Negotiate buffer size and attribute 
characteristics for buffers between 
I/O 



806 



Matrix switch connects all of its I/O to 
adjacent objects with the new buffer 
requirements, attempting to be the 
allocator in all of its pin connections 



No 



810 



808 

Allocator for all I/O? 




Yes 



Buffer copy operations 
will need to be performed 
from input(s) to output(s) 
for I/O which switch is not 
allocator 



812 



Restore connections in remaining 
filters using negotiated buffer 
requirements 




900 



User-defined 
Editing Project 




902 r- 904 906 



MS1-630US 



V 



910 



Data Structure 
representing 
Project, e.g. a tree 




908 



/ \ 
/ \ 
/ \ 




912 



Data Structure 

Utilized to 
Program Matrix 
Switch, e.g. grid 



' A 
B 
C 
T 



0 






0 


1 






2 


0 




0 





\ 



t\me 0 



908 



8 



10 



12 



14 



16 



B 



MS1-630US 




MS1-630US 



1300 



0 2 4 6 8 10 12 14 16 



0 



1300 



0 2 4 6 8 10 12 14 16 



A 
B 



0 






0 





1300 



0 2 4 6 8 10 12 14 16 



A 


0 




B 




0 




C 




0 



1300 



0 2 4 6 8 10 12 14 16 



A 


0 




B 




0 




C 




0 


Trans 




0 





MS1-630US 



1300-^ 



0 2 4 6 8 10 12 14 16 



A 


0 




B 




0 


[0]1 




C 




[0]2 


0 


Trans 




0 





1300-^ 



0 2 4 6 8 10 12 14 16 



(0) A 


0 






(1) B 




0 


[0]1 




(2) C 




[0]2 


0 


(3) Trans 




0 





MS1-630US 



1900 



Provide a matrix switch 



1902 



Define a first data structure that represents 
an editing project 



1904 



Process first data structure to provide a 
second data structure configured to 
program the matrix switch 



1906 



Program matrix switch using second data 
structure 



MS1-630US 



time 0 2 4 6 8 10 12 14 



B 



Effect 



2000-^ 



2100 



© 




0 




© ©^©^ 



MS1-630US 



2200 



0 2 4 6 8 10 12 14 16 



A 


0 




B 




(0]1 




Fx 




0 





2200^ 



0 2 4 6 8 10 12 14 16 



(0) A 


0 




(1) B 




[0]1 




(2) Fx 




0 


[0]2 




(3) C 




[0]3 


0 


(4) T 




0 





A 
B 

FXr 



Trans 



Matrix Switch 


0 


0 


1 




1 


2 




3 






2 


4 






3 



Fx 



Trans 



time 0 



MS1-630US 
2 4 6 8 



10 12 14 16 




MS1-630US 



2700 



(10) A 

(11) B 

(12) C 
(13) 
(14) 



0 



2702 



D 
E 



(15) Mix 




8 



10 



12 



14 16 





[0]3 


[014 








[0]5 




[0]6 




[0]7 


0 



Matrix Switch 



0 



A 
B 
C 
D 
E 



10 

11 
12 

13 
14 



3 
4 
5 
6 

7 



Mix 



15 



MS1-630US 




MS1-630US 





3100 



0 2 4 6 8 10 12 14 16 



(0) A 

(1) /b 

(2) I C 

(3) \t2 

(4) T1 



0 


3 






4 


0 


1 






2 


0 




0 






0 





MS1-630US 



A 
B 
C 



Matrix Switch 

0 
1 
2 
3 
4 



0 

1 

2 

3 
4 



T2 



T1 




MS1-630US 

i 



3900 



Define a multimedia editing project to 
include at least one composite that 
represents multiple tracks as a single track 



3902 



3904 



3906 



Define a first data structure that represents 
the editing project 



Process first data structure to provide a 
second data structure configured to 
program a matrix switch 



Program matrix switch using second data 
structure 



MS1-630 



time 0 2 4 6 8 10 12 14 16 



A 




4000-^ 

4004 ^ 


T 


B 



4002 



4102 



A- 
B- 



Compressed 
Data 




Compressed 
Switch 



decoder 
A O-*- 

B 

decoder 



0 




1 


0 




2 






1 




2 




4100 



0 


0 


1 




2 


1 



4 1 04 Compressed 
Data 
► 




4104a 



Uncompressed Smart Switch 
Data 

-4100a 



TX 



Uncompressed 
Switch 



MS1-630 



4200 



Provide a first matrix switch to process one 
or more compressed data streams to 
provide a compressed output stream 



Provide a second matrix switch to process 
one or more uncompressed data streams 
to provide a uncompressed output stream 



Provide a third matrix switch to receive the 
compressed and uncompressed output 
streams 



Process the compressed and 
uncompressed output streams with the 
third switch to provide a compressed 
project output stream 



MS1-630 



4300 



0 2 4 6 8 10 12 14 16 



(0) A 

(1) B 

(2) Trans 



0 


1 






2 


0 




0 





Grid for Uncompressed Project Portion 



4400 




Grid for Compressed Project Portion 



MS 1-630 



4500 



4502 



Define first data structure defining 
programming for an uncompressed portion 
of a multi-media editing project 



Define second data structure defining 
programming for a compressed portion of 
a multi-media editing project 



4504 



Program one or more matrix switches 
using first and second data structures 



